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ABSTRACT 

The  spectrum  of  the  stationary  synchronous  interval  process  in 
the  stochastic  point  process  obtained  by  superposing  p  Erlang  renewal 
processes  is  derived  by  using  relationships  based  on  the  Palm-Khinchine 
formulae  and  the  fundamental  identity  linking  the  counting  process  of  a 
point  process  to  the  interval  process.   The  spectra  coincide  with  those 
of  mixed  moving  average — autoregressive  processes.   Explicit  results  are 
derived  for  a  few  simple  cases  for  small  p  and  a  computational  formula 
for  the  more  complicated  cases.   Some  general  results  on  the  shape  of 
the  spectrum  of  intervals  are  also  given. 


Prepared  by: 


I .   Introduction. 

Much  work  has  been  done  recently  in  the  area  of  the  superposition 
of  independent  stationary  point  processes,  extending  earlier  results 
summarized  in  Cox  and  Lewis  (1966,  Ch.  8)  and  Cinlar  (1972).   Various 
approaches  have  been  utilized  in  deriving  the  probabilistic  properties 
of  the  superposition  process,  including  the  development  of  expressions 
for  the  description  of  counts  of  events  occurring  in  some  interval  and 
for  the  description  of  the  properties  of  intervals  between  events 
starting  at  an  "arbitrary"  event.   Following  Lawrence  (1971)  we  call 
these  the  synchronous  intervals  of  the  process. 

The  present  paper  considers  the  problem  of  describing  the  second- 
order  joint  moment  structure  of  the  synchronous  intervals  for  the  special 
case  of  the  superposition  of  identical  Erlang  renewal  processes. 

Notationally ,  let  p  be  the  number  of  component  processes  to 
be  superposed  and  let  each  component  process  be  an  Erlang  renewal  pro- 
cess, i.e.  have  independently  distributed  intervals  between  events,  each 
interval  having  the  same  Erlang  probability  density  function 

rk,  k  xk_1  e_kx/y 
gU)  =  Q      ^-TtJ) <x  *  0).  (l.D 

The  superposition  of   p  of  these  independent  processes  gives  the  super- 
posed process  to  be  studied.   We  use  the  description  "Erlang  process" 
rather  than  "Gamma  process"  to  indicate  that  the  shape  paremeter  k 
in  (1.1)  is  an  integer. 

Downton  (1972)  considered  the  problem  of  deriving  the  distribu- 
tions of  synchronous  intervals  in  this  superposition  process  and  utilized 


both  an  imbedded  Markov  property  and  an  integral  equation  approach  to 
develop  limiting  forms  for  the  distributions,  i.e.  for  large  times  of 
observation  and  large  numbers  of  superpositions.   Downton  was  concerned 
with  applications  to  reliability  studies;  note  that  the  superposed 
process  is  the  overall  failure  pattern  for  a  system  consisting  of  p 
renewable  components  operating  in  series,  i.e.  the  system  fails  whenever 
a  component  fails  and  is  renewed. 

Lawrance  (1973),  amongst  other  things,  extended  Downtons  results 
and  showed  that  the  synchronous  intervals  between  events  in  the  super- 
posed process  are  correlated.   He  calculated  the  first  two  serial 
correlation  coefficients  for  specific  cases  of  superposed  Erlang  renewal 
processes,  and  obtained  joint  and  univariate  distributions  of  synchronous 
intervals . 

Barnett  (1970)  used  simulation  to  investigate  some  of  the 
correlational  properties  of  superposed  processes  in  the  specific  area 
of  "studying  the  supply  pattern  of  goods  delivered  to  a  supply  depot 
by  a  fleet  of  vehicles."  His  processes  may  be  considered  to  be  Erlang 
processes  with  large  values  of  k. 

Here  we  develop  somewhat  more  general  expressions  than  those 
given  previously  for  the  serial  correlations  and  the  spectrum  of  syn- 
chronous intervals  in  superposed  Erlang  renewal  processes.   Specific 
forms  for  the  spectra  are  given  for  a  few  cases.   A  general  expression 
for  the  generating  function  of  the  distribution  of  counts  is  used  to  compute 
the  spectrum  of  intervals  and  serial  correlations  in  other  cases.   Some  general 
conclusions  about  the  shape  of  the  spectrum  of  the  intervals  in  the  super- 
posed process  are  given;  these  utilize  results  of  Enns  (1970)  to  the 


effect  that  if  intervals  in  the  component  processes  have  increasing 
failure  rates  (decreasing  failure  rates) ,  then  so  do  the  marginal  syn- 
chronous intervals  in  the  superposed  process.   Enns  (1970)  also  discussed 
serial  correlations  and  tried  to  relate  it  to  the  properties  of  the 
failure  rates  of  the  intervals  in  the  component  processes. 


2 .   Preliminaries . 

Cox  and  Lewis  (1966,  Ch.  4)  used  the  fundamental  identity  of 
point  processes, 


(N(t)  <  k)  «  (Sk  >  t)     (k-1,2,...)         (2.1) 

and  Palm-Khinchine  formulae  to  relate  the  generating  function  of  the 
asynchronous  counts,   c|>(£;,t)  =  E{£     },   to  the  spectrum  of  synchronous 
intervals   {X.}   in  a  stationary  point  process.   The  development  leans 
heavily  on  Laplace  transforms;  for  (1.1)  we  have 


g(s)  = 


g(x)e-SX  dx  =  (^-)k     (Re(s)  *  0) 


0- 

=  (^  s  +  l)"k,  (2.2) 

which  is  a  rational  function  in  s. 

Note  that  the  parametrization  for  (2.2)  gives  an  expected  value 
of  u;   the  intervals  X  can  be  construed  to  be  the  sum  of  k  independ- 
ent exponentially  distributed  variables,  each  with  mean  u/k  =  3» 

Denoting  the  Laplace  transform  of  the  generating  function  for 
counts  in  an  interval   (0,t]   following  an  arbitrary  event  (synchronous 
case)  in  the  point  process  by   <j)f(^;s),   we  have  for  a  renewal  process 
(Cox,  1962,  p.  37) 

♦f^-.til&WH  •  (2'3) 

This  expression  is  simple  looking  but  in  general  difficult  to  invert. 

■k 

Using  $  (£,s)   the  Palm-Khinchine  formulae  (Cox  and  Lewis,  1966,  Ch.  4) 
give  the  Laplace  transform  <j>  (£;s)   of  the  generating  function  for  the 


number  of  events  in   (x,x+t),   where  x   is  an  arbitrary  time  in  a 
stationary  process  (i.e.  the  asynchronous  case).   The  relationship  is 
(Cox  and  Lewis,  1966,  Ch.  4,  p.  68) 

♦*(C;s)  =  £  +  &=p-   4>*U;s).  (2.4) 

If   p  renewal  processes  are  superposed,  we  need  to  develop  a  general 

expression  for  the  transform  of  the  generating  function  of  the  asyn- 

*(p) 
chronous  counts  in  the  superposed  process,  denoted  by  <f>     (£;s). 

This  is  because  the  spectrum  can  be  obtained  as  (Cox  and  Lewis,  1966, 
p.  77) 


00 

f .  (u)  =  \   {1  +  2      I     p,  cos(kw)} 

+         TT  ,   „    K. 


k=l 

_  1  /(e^sOf)  +  **(e-iU);Q+)  f,  .. 

'  tt       2<i>*(0,0+)  -  y      '  K        J 


where  the  p  's  are  the  serial  correlation  coefficients  for  synchronous 
intervals  k  lags  apart,  i.e.   corr{X.,X  ,},   and  the  denominator  is 
var(X.)/E(X.)  =  var(X±)/y. 

In  principle  it  is  easy,  in  the  case  of  superposition  of   p 

*(p)  *(p) 

identical  processes,  to  obtain  $  (£;s)   or  <J>     (£;t),   sine 


e   in 


the   time  domain 


(    \  ^<  +  \  N    (t)+...+N    (t) 

Cp)G-;t)  =E{eN      (t)}=E{.1  p      } 


P  N    (t) 

=    n    UK         > 
i-l 


P 


{o>(C;t)}H.  (2.6) 


However,  if  <\>    (£;s)   is  known,  as  for  the  renewal  process,  to  obtain 

*(p) 
<j>     (£;s)   it  is  necessary  to  perform  the  operations  (using  2.6) 

♦*(5;s)  L+  KC;t)  +  4>(p)U;t)  i  <j>*(p)  (?;s) , 

where  L    denotes  inverse  Laplace  transformation  and  L     a  Laplace 
transform.   Obviously  the  procedure  would  be  cumbersome  for  large  p, 
even  if   cf>  (£;s)   could  be  inverted  to  give  <|>(£;t). 

Section  4  of  this  paper  is  concerned  with  the  development  of 
<l>    (C;t)   or  its  transform  in  the  special  case  of  the  superposition 
of  independent,  identical  Erlang  renewal  processes,  while  Section  5 
develops  the  spectral  density,   f  (w)   for  the  superposed  process. 

Section  6  gives  specific  functional  forms  for  f  (u)   and  the 
p  's   in  the  cases  of   k  =  2  and  p  =  2,3,4;   the  results  are  surpris- 
ingly simple.   In  Section  7  computational  results  for  f  (w)   are  given, 
using  the  general  results  of  Section  5,  for  k  =  2,3  and  p  =  2, 3,..., 9. 
These  illustrate  the  general  form  of  the  spectrum  of  the  superposed  pro- 
cess.  Some  results  for  superpositions  of  non-identical  Erlang  processes 
are  also  given,  corresponding  to  cases  discussed  by  Lawrence  (1973) . 

In  Section  3  we  review  some  results  of  Enns  (1970)  and  show  how 
they  can  be  used  to  derive  some  properties  of  the  spectrum  of  superposed 
renewal  processes,  not  necessarily  Erlang.  All  the  results  are  used  in 
Section  8  in  the  discussion  of  the  general  shape  of  the  spectrum  of 
intervals  of  superposed  Erlang  renewal  processes. 


3 .   Enn's  results  and  the  initial  point  on  the  spectrum. 

It  is  clear  that  the  marginal  time  between  events  in  a  stationary 
superposed  process  X  p   will  have  mean 

E(X(P))  =  E(X)/p, 


where  E(X)   is  the  common  mean  time  between  events  in  the  p  component 
processes.   Let  the  spectral  density  (2.5)  of  the  synchronous  intervals 
in  the  superposition  process  be  denoted  by  f    (w)   and  the  coefficient 
of  variation  squared  by  C2(X        )    =   var (X(p) ) /{E(X(p) }2 .   Then  we  have 
the  following  relationship  between  the  asymptotic  slope  of  the  variance 
time  curve  V  P  (t)  -  var{N  P  (t)}  and  the  initial  point  on  the 
spectrum  (Cox  and  Lewis,  1966,  p.  78): 


llmdvW(t)=Tei(x^f(p)  (3a) 

dt         wv^P-K   + 
t-x»  E  (X    ) 

Now  V  P  (t)  =  pV(t),   where  V(t)   is  the  variance  time  curve  for  the 
component  processes,  and  if  the  component  processes  are  renewal  pro- 
cesses it  is  well  known  (see  Cox  and  Lewis,  1966,  p.  81)  that 

limV.(t)=llmiv£l  =  |!gl 

Putting  these  results  together  we  get,  for  superposed  renewal  processes, 
f  (P)  m  .   p  V(W>>) 

+  TT  C  (X^P;) 


p  C2(X)  x     E(X)     =    C2(X) 
77  E(X)   '  p  C2(X(P))    tt  C2(X(P)) 


(3.2) 


There  are  two  consequences  of  this  result, 


Enns  (1970)  showed  that  if  X  has  an  increasing  hazard  rate 
distribution   (IHR) ,   then  so  does  X  P  ,   and  if  X  has  a  decreasing 
failure  rate  distribution   (DFR) ,   so  does  X  "  .   Thus,  using  results 
of  Barlow  and  Proschan  (1964)  we  have  that 

C2(X(p))  £  1   if   X   is   IHR, 

C2(X(p))  k  1    if   X    is   DFR. 


Consequently 


.2,v(P^    + 


ffp)(0+)  ^  ^Q-       if   X   is   IHR, 


tt  CZ(X^/) 


-  £  ffp)  (0+)  <;  ^^-        if   X   is    DHR. 


tt  C2(X(p))    + 

Note  that  for  the  Erlang  density  function  (1.1),   X  is  IHR  if   k  >  1 
and  DFR  if  k  <  1,   and  C2(X)  =  — .   When  k  =  1  we  have  an  exponential 
density  and  a  Poisson  process  for  the  component  processes  and  the  super- 
position process;  the  spectrum  then  has  the  constant  value  1/tt  and 
f+(0+)  =  f|p)(0+)  =  C2(X)/tt  =  1/tt. 

The  second  consequence  of  (3.2)  is  that  in  the  limit  as  p  ■+■  °°, 
when  the  superposed  process  goes  to  a  Poisson  process  and  C  (X   )  -*■   1, 
the  spectrum  of  intervals  is  tied  down  at   co  =  0 : 

limit  fW  (Of)  -S^L. 

+  IT 

p-x» 

For  the  Erlang  process  this  value  is   l/(Trk).   Thus  the  spectrum,  which 

is  converging  to  the  flat  spectrum  of  the  limiting  Poisson  process,  has 

a  "notch"  in  it  at   co  near  zero.   This  notch  corresponds  to  the  fact 

that  if  we  could  observe  a  superposed  process  well  past  the  mean  of 


intervals  in  the  component  processes,  the  variance  time  curve  would  not 
be  equal  to   t/E(X) ,  i.e.  would  depart  from  linearity.   In  other  words 
low  frequency  effects  and  long  time  effects  correspond. 

It  is  not  known  if   f    (Of)   goes  monotonically  from  1/tt  at 
p  =  1   to   1/(ttIc)   as   p  ->  <».   Computational  results  are  given  in 
Section  7.   It  would  also  be  interesting  to  know  the  derivative  of 
fjp)(w)   at  id  =  0+. 
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4.   General  results  for  the  generating  function  for  an  Erlang  renewal 
process . 

For  the  Erlang  renewal  process,  using  (2.2)  and  (2.3)  and  letting 
X  =  k/u  =1/3,  we  have 

1   "   (xTs")k 

<j>*(C;s)  = 


■U-C<£» 


(X+s)k  -  Xk 
s{(X+s)K  -     XK} 


(4.1) 


Hence,    using    (2.4), 


,*(5;a)    =  1+X(g-1)  .        (X+s)k-Xk 

ks      s{(x+s)k-ak> 


(r){(x+s)k  -  ak}  +  {^%^-}{a+s)k  -  xk} 


ks" 

(x+s)k  -  ak 


P(s) 
Q(s)    ' 


(4.2) 


(4.3) 


where  P(s)   and  Q(s)   are  polynomials  in  s. 

By  expanding  and  collecting  terms  in  P(s)   one  finds  that 

P(s)  =  i  Q(s)  +  ^|^-  (Q(s)  +  Xk(C-D>  (4.4) 

2  k-2        k-1 

=  aQ  +  al8  +  a2s^  +  . . .  +  ak_2s    +  a^s    , 

so  that  P(s)   is  a  proper  polynomial  in  s  of  order  k-1,   with 

aQ  =  Xk_1{k+  (5-1)  (^)}f 

a1  =  Xk"2{ky^Hk+    a-D(^y-)}, 
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a2-Ak-¥k-^f-2>Hk+a-l)ffi}, 


ak-2  - x{k  +  ¥>  > 


ak-l  =  1- 


The  first  derivative  of   Q(s)   with  respect  to   s   is 


Q'(s)  =  k(X+s)k  -1.  (4.5) 


Now  let   {x1,...,T,}   be  the  k  distinct,  complex-valued  roots  of 


?,   i.e., 


Tj  =  C     (j  =  l,...,k) 


The  roots   s.   of   Q(s),   i.e.   Q(s.)  =  0,  are  clearly 

-J  J 

Sj  =  HTj-1)     (j  =  l,2,...,k),  (4.6) 

and  these  too,  like   t.,   are  distinct  and  complex  valued. 

We  are  now  in  a  position  to  use  a  standard  inversion  formula 
(Gardner  and  Barnes,  1942,  p.  338),   for  the  ratio  of  two  polynomials 
when  the  denominator  has  distinct  roots: 


T  t>/  n      k   p(s.)    s-t 
,-l(PXsh     y  j 3 

L      \(s)i        ji1  Q'(s.)  e    ' 


We  note  that  from  (4.4)  and  (4.6) 


P(s  )  =  \-  (7T1)2     (J  =  l,...,k), 

j 


and  from  (4.5) 


k-1 

Q'(s.)  =  k(X+s.)k_1  =  kX   g     (j  =  l,...,k).       (4.7) 
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Consequently,  the  probability  generating  function  for  the  asynchronous 
number  of  counts,   N(t),   in  an  Erlang  renewal  process  is 

<KS;t)  -  Ch*   (C;s)} 

k  P(s.)   s.t 


^Q'Cj) 


q-D2   S      Ti       X(^-1H 


I  7t4tT7  e   J    •         (4.8) 


We  note  too  that  the  expansion  for  the  variance-time  curve  of  an 
Erlang  renewal  process  obtained  by  Serfling  (1970)  is  obtainable  from 
(4.8). 
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5.   General  Results  for  the  Spectrum  of  Counts  for  Pooled  Independent 
Erlang  Renewal  Processes. 

We  consider  here  the  case  in  which  each  of  the  p  component 
Erlang  renewal  process  have  the  same  scale  parameter  X   and  shape 
parameter  k.   The  probability  generating  function  for  counts  in  the 
pooled  process  starting  at  an  arbitrary  time  is,  from  (2.6), 


*(p)(c,t)  =  ua,  t)}p. 


Let  J  =  { j  , j _  , . .  .  , j  },   be  an  index  set.   Using  the  result  (4.8)  from 
Section  4, 


Taking  the  Laplace  transform  of   $    (5,t)   we  have 


n 


T. 


We  note  the  following  in  (2.5): 

(■IT 

(i)     f  (w)do)  A  1, 

(ii)   the  denominator  in  the  second  expression  of  (2.5)  for   f+(u)) 
is  constant  with  respect  to  w. 
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*  (p)     iu)  *(p)     — ioi 

Consequently,    if  we  can  evaluate     $        (e      ,0+)   +  <f>  vr  (e        ,0+)      for 

0  ^  a)  ^  it,      and   integrate   it,    then    (i)   will  give  us   the  value  of 

*(p)  (n) 

tt{2<(>     ^  (0,0+)    -  E(X)}.  Thus  we  will  have     f7F'  (o>)      for     0  £  o>  £  tt, 

and  also     var(X        ).   Now  when     s  =  0+, 


^L\.  (5.3) 

We  are  interested  in  the  cases   £  =   e    and   £  =  e    .We  note  that 


^^  =  5  -  2  +  r1. 


(5.4) 


Thus, 


(c-D2 


?=e 


_  (g-D2 

iw     ^ 


io)   0    -iw    0/n      . 
=  e   -  2  +  e    =  -2(l-cos  oi) 

-10) 


Recall  that   x.   is  a  k    root  of   E.   We  will  now  use  the 
J 


notation 


.  th        ..   ioi 

t.  =  a  k  root  of  e   , 

i      i  th        ,   -ioi 

t.   =  a  k  root  of   e 
J 


In  particular  we  assign  indices  to  these  roots  in  the  following  manner 

T.  =  exp{i(  UJ  -)  },     j  =  l,...,k,  (5.5) 

t.'  =  exP{-i(^^)},    j  =  l,...,k.  (5.6) 


Thus ,   T  .  *  =  T  . 

J    J 
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Taking  real  and  imaginary  parts, 

Re(x.)  =  Re(T.')  =  cos^j^)  ,  (5.8) 

Kt.)  =  -I(t.')  =  sin(^i^)  .  (5.9) 

Because  x . '  =  t .    ,   we  see  that 
3  3 

t.           .  T.' 

.1  1 -     j 

(x.-l)z   t.  -  2  +  x.-l    (t.'-1)z  ' 
3  3  3  3 

Thus ,  for  any  index  set  J , 


n    -. — i 


t/ 


=    n 


j€J(V1>2  ~ih  (Ti'-1)2     £*,  -2+xf1) 


=    n 


l 


j£J   -2{l-cos(2lJ±a))} 

K. 

We  now  consider   the   terms       1/£(1-t.)      and     1/£(1-t.') 
in    (5.3)   when     £      is   replaced  by     e  and      e  respectively. 


(i) 


I      (1-tJ  I        {l-Re(x.)}-i     V      Kt    ) 

jGJ  J  j€J  3  J€J         J 


7   {1-Re(x.)}+  i     I     I(t.) 
lei  3  16J         J  .  (5.1D 

||    I     {l-Re(T.)}-i     I      Kx   )||2 
J6J  J  J6J         J 


(ii) 


J      (1-tJ)  I     {l-Re(T.')}-  i     I     Kt    ') 

j€J  J  j€J  J  J€J  J 


£      {1-Re(x.)}  +  i     I     Kt    ') 


||    J     {1-Re(x .')}    -  i     I     I(t')| 


t  N  I   12 
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I      U-Re(T  )}-i  I      I(t  ) 
j€J J      .16J    j 

I   {1-Re(x  )}-i  I     I(T  )| 


Thus ,  for  any  index  set  J , 


J€J     J    j€J 


where 


and 


Let 


(5.12) 


1  1  2a- 

~ +  ~ 2  Ju    2    »  (5.13) 

I   d-O     I   (1-T.'>    ^   +  V 


aT  =   J   {l-Re(T.)} 

=  I      a-cos(^)}, 


c  =  n  d-cosf^SSL))  .  (5.14) 

J   J6J        k 


Gathering  results  (5.3),  (5.4),  (5.10),  (5.13)  and  (5.14)  we  have 


f 


**"<«)  ~  ♦  Vl"(e   ,0+)  +  ♦  VF/(e  -,0+) 


2a 

2T—  .  (5.15) 


=  7T~    (l-COS  W)       /  V    /  'J  ,,.,J\ 

11  2P  •  -1  -1    a?"bT)CT 

Ak  1,=1     i  =1   J  J  J 

Jl       Jp 

Because  aT,   b   and  c   depend  only  on  the  indices  in  J  and 
not  on  their  order,  the  number  of  distinct  terms  to  be  computed  for  each 
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value  of  a)  is  equal  to   (     )  »   the  f igurate  number  for  k  types 
of  objects  taken  in  sets  of  size  p.   The  computation  time  for  a  , 
b   and  c   is  proportional  to  p,   so  total  computation  time  should 
be  approximately  proportional  to  p   times  the  f igurate  number. 

A  FORTRAN  program  was  written  to  compute  f    (w)   at  intervals 
of   0.05tt.   Various  values  of  k  and  p  having  f igurate  numbers  no 
greater  than  56  were  used.   Computing  times  were  less  than  2  seconds 
per  run  on  the  IBM  360/67  computer.   Some  results  of  the  computations 
will  be  shown  in  Section  7.   First  we  obtain  some  specific  results 
for  small  p   and  k. 
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6.   Specific  results  for  k  =  2  and  p  =  2,3,4. 

The  generating  function  <f>    (£;t)   for  the  superposition  of   p 
identical  Erlang  renewal  processes  is  analytically  tractable  for  k  =  2 

and  small  p. 

1/2  1  /2 

From  (4.8),  with  a  =  -A(l+£  '  )   and  b  -  -X(l-g  '  ),   we 

obtain 

♦  (e;t)  =  -4/9  {-(1-C1/2)2  eat  +  (1+C1/2)2  ebt}.      (6.1) 
4? 

By  taking   {<f>(£;t)}   we  obtain  the  generating  functions  for  the 

superpositions  of  p  such  Erlang  renewal  processes. 

(i)   For  the  case  p  =  2,   we  have 

U(S;t)}2  =  <D(2)(C,t)  =1^  {(1-51/2)4  e2at 

+  (1+C1/2)2  ebt  -  2(l-02  e(a+b)t},   (6.2) 
whose  Laplace  transform  is 

t*(2)(e!.)  .1  jii^lV  il±£^l  .  io=5ii j .        (6.3) 

Y  16£  J  s  -  2a     s  -  2b      s-a-b  1 

From  (6.3)  we  can  obtain  the  spectrum  of  intervals  using  (2.5).   The 
result  is 

fi2)(uO  «±  (1  -^p>)      (OswStt).         (6.4) 

From  (2.5)  we  have  immediately  that  p..  =  -1/10,   p   =  0   for  k  >  1, 
and  the  spectrum  is  that  of  a  first  order  moving  average  process.   This 
generalizes  results  of  Lawrance  (1973),  who  gave  p   =  -1/10,  but  no 
higher  correlations. 
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(ii)   For  p  =  3   the  generating  function  of  the  counting  function  of 
the  superposition  process  is 

*(3)«;t)  =    .).       {-(1-E1/2)6  e3at  +  3(l-C1/2)2(l-5)2  e(2a+b)t 


-  3(lHin)Hl-02   e(a+2b)t  +  (l+C1/2)6  e3bt},   (6.5) 


and  its  transform  is 


.l/2,6    0/1   1/2, 


♦*(3)cg;s)  -  — y-(1"S  )6  +  3d-ex/;)2(i-o^ 

,,  3/zi   s  -  3a        s  -  2a  -  b 

3(l+g1/2)2(l-g)2  ,  (l+g1/2)6 
s  -  a  -  2b       s  -  3a 


Again  using  (2.5)  we  obtain  for  the  spectrum  of  intervals 


(6.6) 


_(3),  v    9  121  -  48  cos  a)  -  9  cos2  co  v 

f+   (W)  =  25TJ 41  -  9  cos  W 1     (Osu^tO.      (6.7) 

This  is  the  spectrum  of  a  mixed  second-order  moving  average  and 
first-order  autoregressive  process  for  which  the  serial  correlations 
are  expressed  by  three  constants,  since  for  k  ^  2   Pi.-,  =  P$,  • 
Equivalently ,  for  k  ^  2,   p   =  C$  . 

In  the  present  case  p  =  -0.1044447,   p2  =  -.0316033, 
p  =  -0.0035118,   or  C  =  -2.55986  and  3  =  1/9. 

(iii)   Skipping  the  details,  we  get  for  p  =  4   the  result  for  the 
spectrum 

,(4)/  .     8  )S71  -  502  cos  co  -  57  cos2  u  -  24  cos3  m, 
f+   (W)  =  3797} 17  -  8  cos  03 
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This  is  the  spectrum  of  mixed  third-order  moving  average  and  first- 
order  autoregressive  process,  so  that  the  serial  correlations  may  be 
expressed  by  four  constants,  since  for  k  >  3,   p,  -.  =  3PV«   Equivalently , 
for  k  £  3,   pk  =  C3k. 

For  the  case  p  =  4,   k  =  2  we  get 


p±   =  -0.0979540 


P2  =  -0.0442821 
P3  =  -0.0150263 
P4  =  -0.0037597 


C  =  -.961683  ; 
3=1/4. 


In  Figure  1  we  show  the  spectra  f    (w)   for  the  superposition 
of  independent  renewal  processes  with  Erlang   (k=2)   interval  distribu- 
tions.  The  calculations  for  p  =  2,3,4,  where  p   is  the  number  of 
processes  superimposed,  are  exact  results  using  (6.4),  (6.7)  and  (6.9) 
respectively.   The  result  for  p  =  5  was  obtained  from  the  general 
results  of  Section  5. 

Note  that  the  initial  points  of  the  spectra  seem  to  be  decreasing 
monotonically  with  p   to  the  value  (      .  ,   while  generally  for  the 
other  w  the  spectrum  seems  to  be  converging  toward  the  flat  spectrum 
of  the  Poisson  limit,  i.e.  — . 
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7 .   Discussion  of  Results. 

The  results  (6. A),  (6.7)  and  (6.8)  giving  a  simple  structure  to 
the  spectra  of  the  superposed  processes  for  p  =  2  and  k  =  2,3  and 
4  are  at  first  quite  surprising.   However,  some  such  structure  could 
be  anticipated  from  (5.15)  which  gives  the  spectrum  f_:p  (oo)   as  a 
rational  function  in  cos  w.   It  has  not  been  possible,  as  yet,  to 
relate  the  parameters  p  and  k  to  the  order  of  the  moving  average 
and  autoregressive  structure,  or  to  give  simple  expressions  for  the 
spectrum  or  serial  correlations.   Knowing  the  order  of  the  structure 
of  the  spectrum  would  be  a  help  in  knowing  how  many  serial  correlations 
one  would  have  to  compute  from  (5.15)  for  specific  p  and  k.   The 
correlations  are  computed  by  calculating   f  (u>)   at  a  sufficiently  fine 
grid  and  then  inverting  the  series  using  a  FFT  algorithm.   (See  Cooley, 
Lewis,  Welch,  1970.) 

There  are  other  theoretical  questions  raised  by  the  results  which 
will  be  discussed  elsewhere.   Briefly  though,  Downton  (1971)  discussed 
the  possibility  of  looking  at  this  particular  superposition  process  as 
a  Markovian  progression  through  pk  parallel  channels,  each  channel 
having  k  stages.   This  may  explain  the  structure.   For  p  =  k  =  2   it 
is  in  fact  possible  to  show  that  the  intervals  are  not  only  uncorrelated 
but  independent  for  lags  greater  than  2. 

We  discuss  now  the  computational  results. 

In  Figure  1  the  spectrum  is  given  for  the  superposition  of  Erlang 
(k=2)   processes  for  several  values  of   p,   the  number  processes  super- 
posed.  This  was  discussed  in  the  previous  section.   A  similar  graph 
is  given  for  k  =  3   in  Figure  2.   Again  as  p   increases  the  initial 
point  of  the  spectrum  decrease  is  converging  slowly  to  the  value  1/tt 
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but  the  remainder  of  the  spectrum  which  would  obtain  for  all  ia     for 
the  limiting  Poisson  process. 

Figure  3  by  contrast  has,  for  fixed  number  p  =  2  of  superposed 
processes,  graphs  for  different  values  k.   As  k  increases  and  the 
component  processes  become  more  regular  with  C2(X)   decreasing,  there 
is  a  larger  peak  at   tt,   or  equivalently  at  a  period  of  T  =  2.   Thus 
the  alternation  of  intervals  induced  by  the  superposition  becomes 
pronounced  in  the  spectrum  of  intervals. 

In  Figure  4  the  case  p  =  3   is  examined  for  different  values 
of  k.   The  tripling  due  to  the  superposition  produces  a  more  and  more 
marked  peak  at  w  =  2ir/3   (period  T  =  3)   as  the  component  processes 
become  more  regular. 

Formulae  such  as  (5.15)  can  be  developed  for  non-identical  component 
processes.   In  Figures  5,  6  and  7  several  cases  of  the  pooling  of  a 
Poisson  and  Erlangian  process  are  given;  the  marginal  distributions 
were  given  by  Lawrance  (1973) .   These  are  important  as  models  for  the 
case  in  which  there  is  one  dominant,  fairly  regular,  process  corrupting 
the  superposition  of  many  sparse  component  processes  which  sum  (almost) 
to  a  Poisson  process.   Note  carefully  the  vertical  scale;  departure 
from  a  flat  spectrum  is  small  and  would  be  hard  to  detect  in  real  data 
unless  the  Gamma  process  were  very  regular.   The  spectrum  of  counts  would 
probably  be  much  more  informative  in  this  case. 

A  short  table  of  computed  coefficients  of  variation  of  the 
marginal  intervals  X  in  the  superposed  process  is  given  in  Table  1. 
These  came  out  of  the  computations  of  the  spectrum. 
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POOLED  ERLANG  PROCESSES 


Coefficient  of  Variation 


P  = 


8 


k=2 


7 

8 


.791 

.833 

.860 

.879 

.893 

.904 

.913 

.920 

.714 

.779 

.819 

.847 

.867 

.882 

.894 

.675 

.754 

.802 

.834 

.652 

.740 

.637 

.732 

.627 

.620 

.615 

TABLE  1 
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8.   Conclusion. 

The  fact  (Cox  and  Lewis,  1966,  Ch.  8)  that  the  variance-time 
curve  and  spectrum  of  counts  in  the  superposition  of  identical  processes 
is  a  scaled  version  of  the  corresponding  components  is  very  useful  if 
p   is  known.   The  crux  of  most  analysis  though  is  that  p   is  not  known 
and  must  be  determined.   The  spectra  of  intervals  computed  here  should 
be  a  very  useful  tool  in  helping  to  determine  p,   and  in  verifying 
assumptions  such  as  those  made  in  Cox  and  Lewis  (1966,  Ch.  8)  in 
analyzing  nerve-pulse  data. 
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CAPTIONS 

Figure  1.  Computed  spectra  of  intervals  for  superposed  Erlang  renewal 
processes  (k=2)  for  several  values  of  p,  where  p  is  the  number 
of  independent  processes  superposed.  For  p  =  2,  3,  and  4  these  are 
exact  results  using  (6.4),  (6.7)  and  (6.9). 

Figure  2.   Computed  spectra  of  intervals  for  superposed  Erlang  renewal 
processes   (k=3)   for  several  values  of  p,   where  p   is  the  number 
of  independent  processes  superposed.   For  all  p   the  results  are 
obtained  from  the  computational  formulae  of  Section  5. 

Figure  3.   Here  the  number  p  of  superposed  processes  is  held  fixed  at 

2,  while  the  parameter  k  in  the  pooled  Erlang  processes  is  increased, 
As  k  increases  the  intervals  in  the  individual  processes  become  more 
regular  and  the  peak  in  the  spectrum  of  the  superposition  process  at 

w  =  it  becomes  more  pronounced. 

Figure  4.   Here  the  number  p  of  superposed  processes  is  held  fixed  at 

3,  while  the  parameter  k  in  the  pooled  Erlang  processes  is  increased, 
As  k  increases  the  intervals  in  the  individual  processes  become  more 
regular  and  the  peak  in  the  spectrum  of  the  superposition  process  at 

a)  =  2tt/3  becomes  more  pronounced. 

Figure  5.   The  spectrum  of  intervals  of  superposed  Poisson  and  Erlang 
renewal  processes  is  plotted  for  increasing  values  of  the  parameter  k 
in  the  Erlang  process.   The  Poisson  and  Erlang  process  mean  values  are 
held  constant. 

Figure  6.   The  spectrum  of  intervals  of  superposed  Poisson  and  Erlang 
renewal  processes  is  plotted  for  increasing  values  of  the  parameter  k 
in  the  Erlang  process.   The  Poisson  and  Erlang  process  mean  values  are 
held  constant. 

Figure  7.   The  spectrum  of  intervals  of  superposed  Poisson  and  Erlang 
renewal  processes  is  plotted  for  increasing  values  of  the  parameter  k 
in  the  Erlang  process.   The  Poisson  and  Erlang  process  mean  values  are 
held  constant. 
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